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1  Introduction 

This  document  is  the  final  technical  report  for  the  Otfice  of  Naval  Research's  con¬ 
tract  N00014-85-K-0550,  Sensor  Array  Proctsaing.  The  contract  was  initiaily 
granted  for  the  period  July  1,  1985  through  June  30.  1988,  and  subsequently  ex¬ 
tended  to  the  period  August  1.  1988  through  July  31,  1991.  The  proposals  sub¬ 
mitted  for  these  two  contract  periods  described  research  issues  specifically  related 
to  the  processing  of  data  produced  by  arrays  of  sensors  as  might  be  encountered  in 
various  remote  sensing  scenarios  and  direction  finding  problems.  VVe  believe  that 
our  research  efforts  in  these  regards  have  produced  significant  results.  Moreover, 
we  successfully  applied  the  understanding  gained  from  our  study  of  sensor  arrays  to 
other  related  problems  including  time  series  analysis  auid  state- space  system  identifi¬ 
cation.  In  addition,  w-e  hav#  developed  new  and  computationally  efficient  numerical 
analysis  procedures  that  render  the  sensor  array  processing  algorithms  developed 
under  this  contract  and  elsewhere  practical  for  “real-time"  implementation. 

The  remainder  of  this  document  is  organized  as  follows.  Section  2  provides 
an  outline  of  the  research  results  obtained  during  the  contract  period.  For  each 
related  group  of  results,  pointers  to  the  various  technical  reports  containing  detailed 
descriptions  of  these  results  are  provided.  Section  3  lists  the  technical  rep>orls 
submitted  earlier  during  the  contract  period,  along  with  the  indexing  keys  used 
in  Section  2.  The  final  section.  Section  4,  tabulates  our  publications  on  research 
related  to  this  contract. 


2  Research  Results 

Narrowband  Sensor  Array  Processing  Algorithms 

The  model  for  the  so-called  narrowband  sensor  array  processing  pro’  iura  is  given 
by  equation  (1).  Its  apparent  simplicity  belies  its  mathematical  complexity  and  its 
applicability  to  a  rich  collection  of  engineering  applications.  The  model  applies, 
for  instance,  to  the  caae  where  signal  propagation  times  across  an  array  are  small 
compared  to  their  bandwidth  which  is  the  origin  of  the  tem.  narrowband. 

i(t)  =  A(©)s(t,0)  +  n(t>  (1) 

0  represents  the  parameters  to  be  estimated  (c.g.  directions  of  arrival)  and  3(t.0) 
is  the  d  dimensional  vector  of  source  signals.  A(0)  is  an  m  x  d  dimensional  array 
mapping  the  source  signals  s  into  m  sensor  outputs,  and  n(t)  represents  additive 
sensor  noise,  This  same  model  can  be  used  for  time  series  analysis  (the  concept 
of  sensors  is  replaced  by  delay-line  taps)  where  the  goal  is  to  estimate  the  number 
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and  frequencies  of  sinusoids  in  noise,  as  wel!  for  .system  identihcation  problems  in 
which  one  has  input  and  output  data  for  a  certain  system  and  wishes  to  estimate 
a  state-space  model.  Our  group’s  research  in  this  axea  concentrated  upon  the 
class  of  subspace  algorithms,  the  progenitor  of  which  was  Ralph  Schmidt's  MUSIC 
algorithm  (tdso  developed  at  Stanford). 

In  the  area  of  algorithm  development,  our  goals  were  the  development  of  al¬ 
gorithms  that  were  more  efBcient  than  existing  algoritiims  and  the  unification  of 
existing  algorithms  in  a  common  framework.  A  key  result  was  the  development  of 
ESPRIT  (Estimation  of  Signal  parameters  via  Rotational  Invariance  Techniques). 
ESPRIT  is  distinguished  by  the  fact  that  it  does  not  require  a  pnort  knowledge  of 
,4(9)  nor  does  it  involve  a  search  in  parameter  space.  These  two  requirements  are 
obviated  by  assuming  a  shift  invariance  structure  that  is  present  in  many  sensor 
arrangements  {e.g.  uniform  linear  arrays,  tapped  delay  lines,  cross  arrays).  Ad¬ 
ditional  invariances  present  in  the  spatial  (temporal)  distribution  of  the  sensors 
can  be  exploited  by  the  MI-ESPRIT  algorithm  (Multiple  Invaxiance)  to  improve 
parameter  estimates.  The  references  for  ESPRIT  are  I,  J  and  L. 

Another  key  development  was  the  SSF  (Subspace  fitting)  framework  and  its 
associated  algorithm  WSF  (Weighted  Subspace  fitting).  SSF  provides  a  single 
unifying  framework  that  subsumes  most  of  the  subspace-based  estimation  tech¬ 
niques,  including  MUSIC,  MD-MUSIC,  Root-MUSiC,  ESPRIT,  beamforming  and 
deterministic  ML  (maximum  likelihood).  Its  associated  algorithm,  WSF.  is  asymp¬ 
totically  efScient  (t'.e.  it  achieves  the  Cramer-Rao  bound)  for  the  stochastic  .VIL 
formulation  of  the  array  processing  problem  at  a  fraction  of  the  cost  associated 
with  a  direct  minimization  of  the  ML  cost  function.  The  references  for  SSF  and 
W'SF  are  J,  K  and  L. 

Statiatical  Analysis  of  Narrowband  Algorithms 

The  unifying  framework  of  SSF  has  proven  effective  In  the  asymptotic  statistical 
analysis  of  subspace- based  techniques  which  it  subsumes.  Performance  analyses 
have  been  performed  for  ESPRIT,  stochastic  ML,  MUSIC  and  MD-MUSIC,  The 
appropriate  references  are  J,  K  and  L. 

Sensitivity  Analysis  of  Narrowband  Algorithms 

Closely  related  to  the  statistical  analysis  of  various  subspace-based  algorithms, 
is  the  einalysis  of  these  algorithms’  sensitivities  to  modelling  errors.  The  spacing  of 
elements  in  a  “uniform  linear  array”  might  not  be  exactly  constant,  for  instance,  or 
the  gain  and  phase  characteristics  of  the  sensors  might  not  be  exactly  known.  The 
effect  of  these  modelling  errors  on  the  algorithms’  performance  can  be  characterized 
using  the  SSF  framework.  The  appropriate  reference  is  L. 

Time  Series  Analysis 

Many  researchers  have  noted  that  the  problem  of  identifying  directions  of  arrival 
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with  a  uniformly  linear  array  is  nearly  identical  to  that  of  identifyirtg  the  frequencies 
of  sinusoids  in  a  uniformly  sampled  time  series.  The  key  difference  is  that  in  the 
former  case  many  data  records,  or  ‘‘snapshots”,  are  obtained  while  in  the  latter 
a  single  data  record  is  obtained.  In  the  time  series  case,  one  typically  forms  a 
matrix  of  ersatz  snapshots  from  the  single  data  record  before  applying  a  subspace 
technique  for  the  purpose  of  frequency  estimation.  We  obtained  results  e.stabiishing 
the  conditions  under  which  this  procedure  will  res'jlt  in  the  desired  esti.Tiaies.  the 
appropriate  reference  is  L. 

Signal  Estimation 

It  is  often  desirable  to  obtain  more  information  than  just  the  directions  of  arrival 
in  a  sensor  array  processing  scenario  or  the  sinusoid  frequencies  in  the  case  of  time 
series  analysis.  One  might  want  estimates  of  the  individual  signals  in  the  array 
processing  case  (so-called  signal  copy).  This  difficulty  of  this  proble.m  is  exacerbated 
when  the  source  signaJs  are  correlated.  Methods  for  estimating  the  source  coherency 
structure  and  for  estimating  signals  in  the  case  cf  correlated  sources  are  described 
in  reference  1.  Similar  problems  arise  in  time  series  analysis  when  the  sinusoids  are 
phase-coupled  —  our  results  in  this  area  are  described  in  references  J  and  K. 

StatC’Space  System  Identification 

Although  linear  state  space  models  have  become  increasingly  important  in  es¬ 
timation  and  control  since  the  pioneering  work  of  Kalman,  they  have  not  been 
widely  used  in  identification.  One  of  the  goals  of  our  research  has  been  to  demon¬ 
strate  that  there  are  some  important  advantages  in  explicitly  considering  general 
state  space  forms  in  identification.  The  methods  we  studied  exploit  a  certain  shift 
structure  in  the  input/output  model  for  the  data.  The  motivation  for  these  new 
algorithms  comes  from  some  interesting  connections  linking  the  state  space  identi¬ 
fication  problem  with  sensor  array  signal  processing.  In  particular,  we  have  shown 
how  the  identification  problem  can  be  cast  in  the  SSF  framework.  Of  special  in¬ 
terest  is  the  fact  that  the  dominant  subspace  can  be  weighted  to  emphasize  certain 
directions  in  the  so-called  “signal”  subspace  where  the  signal-to-noise  ratio  is  high. 
It  has  been  demonstrated  that  for  the  identification  problem,  the  ability  to  prop¬ 
erly  weight  this  subspace  provides  our  algorithm  with  superior  performance  in  cases 
involving  nearly  unobservable  systems  or  an  insufficiently  exciting  input  sequence. 
The  appropriate  reference  is  M. 

Numerical  Analysis  Results 

A  step  common  to  ail  subspace  algorithms  is  the  estimation  of  the  so-called  “sig¬ 
nal  subspace”.  Classically,  this  is  obtained  via  an  eigendecomposition  of  the  es¬ 
timated  measurement  covariance  matrix,  requiring  O(m^)  operations.  This  op- 
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eration  often  dominates  the  computational  requirements  of  a  subspace  algorithm 
and  often  renders  real-time  implementations  infeasible.  The  FSD  (Fast  Subspace 
Recomposition),  developed  under  this  contract,  obtains  the  signal  subspace  m 
0{m^d)  steps.  In  time  series  analysis  problems,  for  example,  m  can  be  on  the 
order  of  100  (typically,  d  m)  and  the  computational  savings  afforded  by  FSD 
are  manifest.  The  appropriate  reference  is  M. 

Wideband  Sensor  Array  Processing  Algorithms 

WTien  signal  propagation  times  across  an  array  are  not  small  compared  to  their 
bandwidths,  the  model  of  equation  (1)  no  longer  applies.  A  number  of  approaches 
are  possible  in  this  case;  we  investigated  two  in  particular.  Using  a  wideband 
subspace  model  developed  by  Su  and  Morf,  we  investigated  a  wideband  extension 
of  the  ESPRIT  algorithm.  Sensor  outputs  are  preprocessed  in  the  time  domain  to 
identify  the  poles  of  the  emitter  signals  and  ESPRIT  is  subsequently  applied  at  the 
identified  poles.  ESPRIT  is  particularly  well  suited  to  this  problem  as  knowledge  of 
the  array  response  (as  a  function  of  frequency  as  well  as,  say.  angle)  is  not  required. 
This  work  is  reported  in  I,  J  and  K. 

Alternatively,  one  can  exploit  structural  features  of  the  emitter  signals  in  the 
wideband  case.  Many  digital  communication  signals  [t.g.  BPSK,  QPSK.  FSK)  ex¬ 
hibit  cyclostationaxity.  This  property  can  be  used  to  advantage  in  the  wideband 
scenario  and  also  for  the  purpose  of  reducing  co-channel  interference.  The  appro¬ 
priate  references  are  L  and  M. 

The  issue  of  adaptive  beamforming  for  wideband  systems  was  also  addressed. 
The  typical  structure  employed  for  this  purpose  is  a  bank  of  parallel  tapped  delay 
lines  with  adaptive  weights  at  the  output  of  each  sensor.  We  developed  a  fast  and 
numerically  stable  multichannel  RLS  (Recursive  i^east  Squares)  algorithm  based 
on  an  underlying  transversal  filter  architecture.  These  results  are  significant  not 
only  because  they  provides  a  fast  algorithm  for  RLS,  but  because  they  debunked 
the  widely  held  notion  that  stable  transversal  filter  RLS  implementations  were 
impossible.  This  work  is  discussed  in  reference  1. 

Nearfieldl  Sensor  Array  Processing 

In  both  the  narrow  amd  Avideband  situations  described  above,  it  is  assumed  that 
the  emitters  are  in  the  aurray’s  far-field  so  that  the  emitter  wavefronts  may  be 
modelled  as  plane  waves  at  the  array.  When  the  emitters  are  in  the  array’s  near¬ 
field,  the  curvature  of  the  emitter  wavefronts  must  be  taken  into  account.  Using 
a  Fresnel  approximation  for  the  wavefronts,  aji  algorithm  employing  the  Wigner- 
Ville  Distribution  of  the  sensor  outputs  and  ESPRIT  was  developed  that  generated 
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range  and  bearing  estimates  for  the  emitters.  A  discussion  of  this  algorithm  and 
Cramer-Rao  bound  comparisons  is  provided  in  reference  1. 


3  Technical  Reports 

The  following  table  lists  the  various  technical  reports  submitted  in  accordance  with 
the  contract.  The  column  labeled  “Key”  is  the  indexing  key  used  in  Section  2  to 
refer  a  particular  report.  The  interim  technical  report  of  July,  1988,  1,  subsumes 
the  reports  predating  it  and  is  therefore  referred  to  in  Section  2  to  their  exclusion. 


Key 

O&te 

Type 

Title 

A 

Jan, 1986 

Semi-Annual 

Sensor  Array  Processing 

B 

Jun, 1986 

Semi-Annual 

Sensor  Array  Processing 

C 

Jul,  1986 

Annual 

Sensor  Array  Processing 

D 

Jan, 1987 

Semi-Annual 

Sensor  Array  Processing 

E 

May,  1987 

Semi-Annual 

Sensor  .Array  Processing 

F 

Aug,  1987 

Annual 

Sensor  Array  Processing 

G 

Oct,  1987 

Progress 

Wideband  Direction  oj  Amool  Techniques 

H 

Dec,  1987 

Semi-Annual 

Sensor  Array  Processing 

1 

Jul,  1988 

Interim 

Recent  Advances  in  Sensor  Arroy  Processing 

J 

Jan, 1989 

Semi-Annual 

Sensor  .4m3y  Processing 

K 

Jul,  1989 

Annual 

Sensor  Array  Processing 

L 

Jan, 1990 

Semi-Annual 

Sensor  Array  Processing 

M 

Jul,  1990 

Semi-Annual 

Sensor  Array  Processing 
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to  Determine  Sensor  Gain  and  Phase  with  Applications  to  .Array  Processing, 
SPIE's  SOih  Annual  Tech.  Symposium,  pp.  102-109,  San  Diego,  CA,  August 
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tional  Invariance  Techniques  -  ESPRIT,  1986  IEEE  Military  Communications 
Conference,  October  1986,  Monterey,  C.A. 
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10 


_ a  1  >' 


T 


Q. . >  CLd 


1  g  ■ 


Sf  \T  BV:SIAM0RD  IM\ 


111  a  i i;  I  ic\; 


I  \(  1 1  s'!  1  (  U' 


(  (  III  - ! ;; 
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[25]  R.  Roy  and  T.  Kailath,  Invariance  techniques  and  high  resolution  null  steer¬ 
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